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AHHOTaiTHH 

A parallel algorithm for computing the finite difference solution to the elliptic equations with non- 
separable variables is presented. The resultant matrix is symmetric positive definite, thus the preconditioning 
conjugate gradient or the chebyshev method can be applied. A differential analog to the Laplace operator 
is used as preconditioner. For inversion of the Laplace operator we implement a parallel version of the 
separation variable method, which includes the sequential FFT algorithm and the parallel solver for 
tridiagonal matrix equations (dichotomy algorithm). On an example of solving acoustic equations by the 
integral Laguerre transformation method, we show that the algorithm proposed is highly efficient for a 
large number of processors. 

KjiHDHeBMe cjioBa: TpexflHaroHajiBHBie cucTeMBi ypaBHeHHH, napajijiejiBHBiH ajiropuTM nporoHKH, Parallel 
Dichotomy Algorithm, MeTOfl paaflejieHiia nepeMeHHBix, sjuinnTHHecKHe ypaBHeruia c Hepa3flejiaeMBiMH 
nepeMeHHBiMH, npeo6pa30BaHne Jlareppa, ypaBHeruie axycTHKH. 

1 BBefleHHe. 

CymecTByeT o6nnipHbiH Kjiacc sa^ian (MO^ejiiipoBaHiie bojihobmx nojieft, nojiynpoBO/nriiKOBbix npn6opoB, 
3a,n,aHH Tenjioo6MeHa, rH^zrpo^zniHaMHKH h pp.) [TJ [3J [3J 2] , b paMKax KOTopbix Tpe6yeTCH peniHTb He OflHy, a 
cepino ypaBHeHiiii c nocTOHHHbiM onepaTopoM h pa3jiHHHbiMH npaBbiMH lacTHMH 

V[/s(r)V«i] -q(r) Ui = -fi(r), r € R", i = 1,2,3, K (r) > 0, q(r) > i = 1, ...M. (1) 

B CHjiy Toro, hto npn penieHHii coBpeMeHHbix npo6jieM MaTeMaTHnecKoro MO/rejinpoBaHHH kojihhcctbo 3a/i,aH 
b cepHH MOJKeT floCTHraTb HecKOjibKHx tmchh, pa3yMHO npoBOfliiTb Taxne pacneTti Ha cynepKOMnbiOTepe. 

K cojKajieHHio, pjin SojibiniiHCTBa skohomhhhmx HHCjieHHbix MeTOflOB, pa3pa6oTaHHbix fljia penieHHH pa3- 
hocthbix ypaBHeHHH (nonepeMeHHO-TpeyrojHjHbiii MeTOfl, MeTOfl nepeMeHHBix HanpaBjieHiiii, niiKjinnecKon 
pe,nyKHHH h T.fl.) [S], hx peajiH3anHH Ha MHoronpoueccopHbix BbiHHCjiHTejibHbix CHCTeivrax He npHBOflHT k 
3naHiiTejibHOMy coKpaineHHio BpeivreHH cneTa. 3to aBjiaeTca cjieflCTBHeM Toro, hto npn TeopeTHnecKHx oueH- 
Kax KanecTBa nocjieflOBaTejibHbix ajiropHTMOB orpaHHHHBaiOTCH tojibko noflcneTOM HHCjia apncpMeTHnecKHx 
onepaipra, Heo6xo,u;HMi>ix ,h,jih OTbiCKaHHH penieHHH c 3a,naHHOH TOHHOCTbio. B to »ce BpeMH aHajni3 pa6oT no 
flaHHOit TeiviaTHKe [SJ [7] noKa3biBaeT, hto Ha STane KOHCTpynpoBaHHH HHcneHHoro MeTO/ia pjisi penieHHH 3a,naH 
Ha cynepKOMnbiOTepe Heo6xo,n,HMO ,n;onojiHHTejibHO yHHTbmaTb BpeMeHHbie 3aTpaTbi Ha Meacnponeccopribic 
B3aHMO,n,eHCTBiiH. HecMOTpn Ha to hto penieHHio 3aflann ([T]) Ha cynepKOMnbiOTepe nocBHineHO 3HaHHTejn>Hoe 
hhcjio pa6oT [51I51 I101I11H121H5] . ecTb o6cTOHTejibCTBa, KOTopbie /rejiaiOT HCCJie/ipBaHHH b stoh o6jiacTH Becb- 
Ma aKTyajiBHbiMH. TaK, nocTOHHHbiii pocT nncjia (nponeccopHbix sjicmchtob) 113, o6 r be/niHeHHbix b paMKax 
o/nroro cynepKOMnbiOTepa, npe/rbHBjiHeT Bee 6ojiee a;ecTKHe Tpe6oBamiH k MacniTa6HpyeMOCTH HHCjieHHbix 
ajiropHTMOB . HanpiiMep, ajiropHTM iiiiKjiHHecKoii pe^yKinrn |51 1141 [T51 116) arpcpeKTHBeH npn Hcnojib30BanHn 
OTHOCHTejibHO ne6ojibnioro nncjia nponeccopoB, nosTOMy ero peajiH3anHH Ha coBpeMeHHbix napajijiejibHbix 

BblHHCJIHTejIbHblX CHCTCMaX CHJIbHO OrpaHHHeHa. TaKHM o6pa30M, OflHHM H3 Tpe6oBaHHii, npeflljHBJIHeMblX 

k pa3pa6aTbiBaeMOMy napajijiejibHOMy ajiropHTMy, HBjineTCH bosmojkhoctb ero scnqbeKTHBHOii peajiH3aniiH 
Ha cynepKOMnbiOTepe ,hjih 6ojibinoro nncjia npoueccopoB (ot tmchhh h 6ojiee) . 

flonojiHHTejibHO ot MeTOfla penieHHH 3aflanH ([1]) Heo6xo/niMO Tpe6oBaTb ero skohomiihhocth, TaK KaK b 
npoTHBHOM cjiynae cmmcji napajijiejibHOii peajni3aHHH mojkct 6biTb b 3HanHTejibHOH CTeneHH yTpanen. 

B npoflOjiJKeHHH pa6oTbi [17] . b KOTopon npefljiojKen hobbih ajiropnTM napajijiejibHOii nporoHKH ,zyiH 
MyjibTHKOMnbiOTepa: AjiropHTM jUhxotomhh, b CTaTbe nccjie/ipBaH napajijiejibHbiii ajiropHTM pjisi penieHHH 
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cepiiH ypaBHeHHii BH,n,a ([T]) b in-ijinHflpiiHecKoii CHCTeMe KOopfliraaT Ha npHMoyrojiMOH ceTKe. 3<pcpeKTHB- 
hoctb npe/i,jiaraeMoro no/rxofla nccjieflOBana b paMKax peajin3aHHH HHCjieHHO-aHajiHTHnecKoro MeTO^a pe- 
ineHHH ypaBHeHHa aKycTHKH |18] . 

CipyKTypa CTaTbii cjie/ryioiHas:. B nacTH 2 cpopMyjinpyeTCH KpaeBaa 3a/i,ana pjin sjijinnTHnecKoro ypaB- 
HeHHii BToporo nops,n;Ka b aKCHajitHO-CHMMeTpuHHOii reoMeTpnii. 06cy»cflaeTCH Bonpoc o Bti6ope HTepann- 
OHHOii npone/rypti peinenHH pa3HOCTHbix ypaBHeHHii c yneTOM ee nocjie/ryioineH peajiH3annn Ha cynepKOM- 
ntiOTepe. B KanecTBe npe r no6ycjiOB.jiHBa:EOinero onepaTopa paccMaTpiiBaeTca onepaTop Jlanjiaca. B Hacra 
3 paccMOTpeH ajiropnTM napajijiejiMioii nporoHKH (AjiropHTM ^hxotomhh) . B nacTH 4 pacciviaTpnBaeTCH 
MOflejibHaa 3a,nana o pacnpocTpaHeHHii axycTHHecKHx bojih b Heo/nropoflHoii cpe,n;e. IIpHBOflHTCfl; ohchkii 
tohhocth nojiynaeMoro peineHHH, nccjie/iyeTCH sepcpeKTHBHOCTb pacnapajijiejiHBaHHH. B nacTH 5 no/i,BO/i,a:T- 
ca HTorn npoflejiaHHOii pa6oTbi. 



2 IlapajiJiejibHbiH AjiropHTM peniemia pa3HOCTHt>ix ypaBHeHHH. 
2.1 IIocTaHOBKa 3a^aHH. 

B npaMoyrojibHoii o6jiacTH G = {0 < r < l±, < z < l 2 } c rpaHnneii T paccMOTpHM cjieflyiomyio KpaeByio 
3aflany BH,a,a (p} 



dr 



du 

dz 



(2) 



\r=h 



(J. 



(r,z)er. 



(3) 



^jih o6ecneHeHHH cymecTBOBaHHH h c^hhctbchhocth penieHna 3a,n;aHH @ noTpe6yeM BbinojiHeHHH cjie- 
/ryronnix HepaBeHCTB [5]: 

< s 1 < n(r, z) < s 2 , 
< di < q(r,z) < d 2 . 

Ha npHMoyrojibHoii ceTKe u) ~ uj r x w z = w IJ 7 i r fl e 

ui r = {n = {i- 0.5)fti, i - 1, N h hi = ii/(JVi - 0.5)} , 

w 2 = {z fe = (fc - 0.5)^2, fc = 1, JV a , hi = l 2 /(N 2 - 0.5)} 
lu = u) P| G, 7 = wp|r ^,H(p(pepeHH,Hajii.Hoii 3a,naHe ([2]) cooTBeTCTByeT pa3HOCTHaa 3a,naHa[5j 119) 



(A r + A- z ) y - w(x)y 



x £ ui. 



(4) 



A r y 



—aiy r , i = 1 



(OlI/r) r , 1 < * < Nl_ - 1 



1 

h z 

(a 2 y s ) z 
1 



fc = 1 

1 < k < N 2 - 1 



7—022/2, k = N 2 
< h z 



KoscpcpHinieHTbi pa3HOCTHOii cxeMbi 6yfleM onpe^ejiaTb no cpopMynaM 

ai(i, fc) = fj/c (fj, z fe ) , a 2 (i, fc) = r,/t (rj, z k ) 
w(i,k) =riq(n,z k ), </>(i,j) =nf(n,Zk), 



(5) 



(6) 



r^,e fj = ri + 0.5/t.i, Sfc = Zfc + O.5/12; J/f 7 J/z h y r , y 2 - pa3HOCTHbie cooTHOHiemia no z h no r M Ha3a,n" h 
"Bnepefl" |19| . KpaeBoe ycjiOBne Ha CTopoHe r = l 2 annpoxcHMnpyeM tohho yN u k = 0, k = 1, ...,N 2 . 

CxeMa (H])-© Ha ceTKe a; o6jiaflaeT btopbim nopHflKOM annpoKCiiMan;HH h HBjiaeTCH KOHcepBaTHBHOfi. 
IlocKOjibKy fljia cxeMbi (|4]) npo6jieMbi tohhocth, cxo^hmocth h ycToiiHHBOCTH floCTaTOHHO nojiHO nsyneHbi 
HanpnMep b |19] . b flajibHeiiineM mm He 6yneM ocTaHaBjiHBaTbca Ha sthx Bonpocax, a o6paTHM ocHOBHoe 
BHHMaHiie Ha napajijiejibHbie ajiropnTMbi peineHHH pa3HOCTHoro ypaBHeHna (j4]). 
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2.2 AjiropHTM peuieHHa pa3HOCTHoro ypaBHeHHa. 

Pa3HOCTHyio 3a,a,aHy ([4]) 6y,a,eM TpaKTOBaTb KaK onepaTopHoe ypaBHeHiie b BemecTBeHHOM KOHennoMepHOM 
rHjib6epTOBOM npocTpancTBe H 

Au = f, A: H -» H, (7) 

rjre A He BbipojKjreHHbiH, jinHennbin, caMOConpHJKeHHbift (A = A*) n nojioJKHTejibHO onpeflejieHHbiii onepaTop 
(A > 0) 0. 

fljia npn6jiH>KeHHoro peineHHH 3&jia^m ([7]) paccMOTpmvi neHBHbin iiTepannoHHbin nponecc 

B V^Vk +Ayk = fi B : H -> H, 

r k+ i (8) 

Vk+i = a k +iy+ (1 - ak+i)yk-\, k = 1,2... 

c npoH3BOjibHbiM HanajibHbiM npH6jiH»ceHHeM ya G H [5]. IlapaMeTpbi {r^} h onepaTop i? (npe,a,o6ycjiaBjiH- 
BaromHft) cjie^yeT Bbi6npaTb H3 ycjiOBna MHHHMyMa Hncjia HTepannii, npH kotopom 

II z n ||=|| y n -u\\<s || y -u ||, (9) 

r,n,e m - TOHHoe penieHne 3a/i,aHH ([7]), a e > - Tpe6yeMaa TOHHOCTb. 

PaccMOTpHM Bonpoc o Bbi6ope npe,ii;o6ycjiaBjiHBa:EOinero onepaTopa B H3 Kjiacca onepaTopoB, o6jia,a,aio- 

DXHMH CJieflyiOLLI,HMH CBOHCTBaMIi: 

1. B = B* > 0, caivioconpajKeHHOCTb h nojio>KiiTejibHaa onpeflejieHHOCTb. 

2. OnepaTop B flOjoKeH 6biTb " snepreTHnecKiin SKBHBajieHTeH" onepaTopy A b CMbicjie HepaBeHCTB 

7i (Bu,u) < (Au,u) < 72 (Bu,u) ,Vu; < 71 < 72, (10) 

rfle 

. (Ax,x) (Ax,x) 
7! = mm , 72 = max . 

x^o (Bx,x)' x^o (Bx,x) 

3. OnepaTop B flOjuKeH 6biTb jierKO o6paTiiMbiM, no cpaBHennio c onepaTopoM A. 

4. TaK KaK paccMaTpnBaeMbiii ajiropHTM npejxnojiaraeTCH peajni30BbiBaTb Ha MHoronpoueccopHbix bh- 
HHCjiHTejibHbix CHCTeMax, ecTecTBeHHO Tpe6oBaTb, HTo6bi npone/rypa o6pam,eHHa npe,n;o6ycjiaBjiHBaio- 
mero onepaTopa ^onycKajia scpcpeKTHBHyio napajijiejibHyio peajiH3ainiio. 

B pa6oTax [5lt20 ; 21 , 22] |23l[2"l] HCCjiejxpBaHbi pa3jiHHHbie ajiropHTMbi pjin pemeHiia sjijinnTHnecKHx ypaB- 
HeHiiii BToporo nopsflKa c nepeMemibiMH KOScpcpiiniieHTaMH, b kotopmx HTepainiOHHbiH npouecc cbo/hitch k 
MHoroKpaTHOMy pemeHHio ypaBHenna IlyaccoHa. H3BecTHo[S], hto cjiynae B = A oneHKa hhcjki oGycjiOB- 
jieHHOCTH cond (^B~ 1 Aj = 72/71 He 3aBHCHT ot niara ceTKH, noaTOMy flaHHbift Kjiacc npe^;o6ycjiaBjiHBaTejieH 
3(pcpeKTHBeH, HanpHMep, b sajjanax ceftcMnnecKOH pa3Be;jKH |25| . rjre npn yMepeHHOii KOHTpacTHOCTii cpe,a,bi 
Tpe6yeTca npoBO,zniTb pacneTbi c GojibinHM hhcjiom y3JiOB, npHxoflHiiniMCH Ha xapaKTepHyio fljiimy bojihm. 

B |17| npefljiojKeH ajiropHTM jxhxotomhh pjin pemeHHH TpexjxnaroHajibHbiH chctcm ypaBHeHHii, KOTopbifi 
no3BOjiHeT jj,ocTHHb BbicoKOii npoii3BO/i,HTejibHOCTH npn napajijiejibHoit peajiH3aniiH TaKHx ajiropiiTMOB, KaK 
MeTOjr pa3flejieHHH nepeMenHbix [5J [SJ 126) , MeTOfl nepeMeHHbix HanpaBjieHHft [SJ I27[ 128] , iniKjinnecKoii pe- 
jjyKiniH [U [5J 129) . Iicnojib30BaHHe sthx napajijiejibHbix nponejxyp jijia o6parn,eHiis pa3HOCTHoro aHajiora 
onepaTopa Jlanjiaca, no3BOjiHeT yflOBjieTBopHTb Tpe6oBaHino 4, npe/rbHBjiaeMOMy k npe,n;o6ycjiaBjiHBaiorn,e- 
My onepaTopy h Bbi6paTb ero b BHjje|24) 

2 2 y J 

nocKOJibKy AB- l A = (AB^A)* , TO ^JIH BblHHCJieHHH HTepaH,HOHHbIX napaMBTpOB MOJKHO HCnOJIb30BaTb 

MeTO,a, He6bimeBa hjih MeTOjj, conpHJKCHHbix rpa,n;HeHTOB(S]. C tohkh 3peHiia napajijiejibHofi peajiH3an,iiH npe- 
HMymecTBO MeTO,a,a HeGbimeBa no cpaBHeHino c BapnannonHbiMH MeTO^aMn coctoht b OTcyTCTBne onepa- 
n,Hn CKajiapHoro npon3BeflennH Hajj, pacnpe^,ejieHHbiMH ^aHHbiMH, a cjieflOBaTejibHO, h KOMMynnKai^nonnbix 
B3anMO,n,eHCTBHH Tnna "All-to- All- Reduce" [301 131) . Hajmnne TaKoro po,na KOJijieKTHBHbix B3anMOflencTBHH 
cnnjKaeT npoii3BO,i],HTejibHOCTb n MacniTa6iipyeMOCTb napajijiejibHoro ajiropnTMajB]. 

B cjiynae BbicoKOKOHTpacTHbix cpejj, Bbi6paHHaH npeflo6ycjiaBjmBaion];aH npon;eflypa mojkct h He o6ec- 
nenHBaTb bmcokoh ckopocth cxojj,hmocth HTepai^noHHoro npon,ecca, 6ojiee Toro, HHor^a Ha6jno/i,aeTCH ero 
pacxoaHMOCTb[2^] . B stom cjiy^ae mojkho peKOMenflOBaTb MeTOflbi c BbiflejieHneM rpaHnnbi pa3pbiBOB cpe/i,, 
KOTopbie TaK»ce Tpe6yiOT o6pam,eHHH onepaTopa JIanjiaca |32[ 133) . 
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3 AjiropHTM /],hxotomhh ,a,Ji5i penieHHH cepHH Tpex^,HaroHajit>Hbix 
CHCTeM ypaBHeHHii. 

Hcnojib30BaHiie telkhx MeTOflOB, KaK MeTOjj, pa3jj,ejieHHJi nepeMeHHbix, MeTOfl nepeMeHHbix HanpaBjienHit hjih 
niiKjiH^iecKOH pfiTiy KTra M b paMKax cxeMbi (J5| flJia o6parneHH5i onepaTopa B = A, Tpe6yeT MHoroKpaTHoro 
peineHHH TpexfliiaroHajibHbix CJIAY c ojthoh ii Toii :sce MaTpiinen, ho pasjiiiiHMMii npaBbiMii nacTSMii 



AX; = Fi, i = l,2...M, 



(12) 



.4 



C2 h 







(l 2 



C n -1 



b n -l a n-l 

c b 



PaccMOTpiiM AjiropiiTM ,Hhxotomhh [17] , pa3pa6oTaHHbiit pjin peineHHH stoh npo6jieMbi. 
3.1 /l,eKOMno3Hii,Ha ,a,aHHL.ix. 

Bbi6op cnoco6a ,n;eKOMno3iinHH flaHHbix 3aflanH 0Ka3biBaeT cymecTBeHHoe BjniHHHe Ha BbinncjiHTejibHyio h 
KOMMyHHKan,HOHHyio TpyfloeMKOCTb napajijiejibHoro ajiropHTMa, a b HTore h Ha BpeMH CHeTa[34] . IIoaTOMy 
paccMOTpHM Bonpoc OTo6pajKeHHH flaHHbix 3aflaHii (|12|) Ha MHOJKecTBO nponeccopHbix sjieMeHTOB (113). 

IlycTb hhcjio 113 paBHO p. Pa3o6beM BeKTop npaBoii Hacra h BeKTop penieHira F h X Ha nojTseKTopbi 
Qi, Ui cjie/ryioinHM o6pa30M: 



F — (Ql, Q2, Qp) T — (/li /2, /size{F}-l, fsize{F}) 



(13) 



X = (Ui,U 2 , ...,U p ) = (xi,X 2 , -,X s ize{X.}-l,Xsize{X.}) ■ ( 14 ) 

IIojiaraH hhcjio sjieMeHTOB HexoToporo BeKTopa V paBHbiM size{V}, noTpe6yeM BbinojiHemra cjiejryioinHx 

yCJIOBHH 

size{Qi} = size{XJi} > 2 i = 1, 

Z)i=i s^e{Q t } = Yh=i size{\Ji\ = size{X}. 

Byn,eM CHHTaTb, hto 113 c HOMepoM i npHnajijiejKHT napa no^BeKTopoB (Qi,Ui), a CTpoxa MaTpnnbi A 
c HOMepoM j npHHafljiejKHT TOMy 113, Ha kotopom pacnojiojKeHa napa sjieMeHTOB (xj, fj) H3 ()13l) . (|14p . 
,24,onojiHHTejibHO BBejreM cjieflyiomiie o6o3Ha x ieHiiH: 

• 06o3Ha ii niM nepBbifi 11 nocjiejjHHe KOMnoneHTbi HeKOToporo BeKTopa V KaK first{V} h lastl'V}. 

• TIpHMeM 3a {A}[ MaTpuny, nojiynaioinyiocH H3 MaTpnnbi A nyTeM OT6pacbiBaHHeM Bcex ctpok h ctoji6- 

H,OB C HOMepaMH MeHblHHMH I HJIH 6ojIbIHHMH t. 

• IIpHMeM 3a {V}[ noflBeKTop, nojiynaioinHHCJi H3 BeKTopa V nyTeM OT6pacbiBaHHeM sjieMeHTOB c ho- 

MepaMH MeHbHIHMH I HJIH 6ojIbHIIIMII t. 

3.2 /M,HxoTOMHa CJIAY. 

AjiropHTM II^hxotomhh |17| HBjiHeTCH npeflCTaBHTejieM Kjiacca ajiropHTMOB H3BecTHoro, KaK "Divide & 
Conquer " |351 [3"6l 137| . Ha KaatflOM ypoBHe jthxotomhh (pnc. [T]) Tpex/niaroHajibHaH CHCTeMa ypaBHeHHii, no- 
jiyHeHHaa Ha npejrbiiiyineM mare, nyTeM BbiHHCjieHHH penieHiiii b (X) m[ = first{\J m }, (X) mn = last{\J m } 
- KOMnoHeHTax pa3,ii;ejia:eTCH Ha Tpn He3aBHCHMbix noflCHCTeMbi MeHbrnnx pa3MepHOCTeft 



{AX} 



rriR — 1 



{AX}™-- 1 = {F}'^- 1 - am^firstiU^, 
= { F }Zl+i ~ c mL +ie R first{\J m } - a mi? _ie L /asi{U m }, 
{AX}" , , = {F}™ +1 - c mR+1 la S t{U rn }e R , 



(15) 
(16) 
(17) 



e K = (1,0,0,..., 0) T , e L = (0,..,0,0,l) i . 



ygOBgHb 1 



f 




flpoueccopbi 1 


m-1) 






last(U 


rippnecc 












npoi^eccopbi 


):p- 











( u m + 1-U m+ 2 Utf 



Phc. 1: IIpon,ecc pa3flejieHHa Tpex/niaroHajibHOH CJ1AY Ha He3aBHCHMBie no,n,CHCTeMbi. 



^ajiee, ajiropiiTM pa3flejieHHH peKypcHBHO npHMeHaeTCH k no^CHCTeMaM (j 1 5[) . (j 1 7|) . B iiTore nepe3 [log 2 p] 
inaroB iicxo/niaa CHCTeMa ypaBiieHHH (j 12|) 6yneT pa3,nejieHa Ha p He3aBHCHMbix noflciiCTeM Bii^a ()16|) . Ha 
3aKjnoHHTejibH0M uiare AjiropHTMa ^hxotomhh Ha KajKflOM npoueccope onpeflejiaeTca: pemeHHe saflan ()16|) 
c noMomtio jno6oro nocjie,n,OBaTejibHoro BapnaHTa ajiropHTMa nporoHKH [5j 1 14] . 

,H,ocTaTOHHbiM ycjiOBHeM npHMeHHMOCTH AjiropHTM ^hxotomhh HBjiHeTCH Hajninne /niaroHajibHoro npe- 
o6jia,n,aHHH MaTpnnbi CJIAY. IIo tohhocth, nncjiy apncpMeTHnecKHx onepainiii h KOjinnecTBy KOMMyHHKa- 
iniOHHbix B3aHMOfleitcTBHH AjiropHTM ,H,hxotomhh npaKTHHGCKH SKBHBajieHTeH MeTO/ry u,HKjiHHecKofi pe/ryK- 
hhh |14| . OflHaKO npn conocTaBHMbix o6 r beMax nepeflaBaeMbix flaHHbix peajibHoe BpeMH MejKnponeccopHbix 
B3aHMO,n,eHCTBHH AjiropHTM ^hxotomhh cymecTBeHHO MeHbHie. 3to o6 r bHCHHeTCH TeM, hto Bee MejKnpo- 
ueccopHbie oGMeHbi MoryT 6biTb ocymecTBjieHbi nepe3 nocjie/jOBaTejibHOCTb bmsobob kojijicktiibhoh one- 
painiH "All-to-One-Reduce(+)" . YneT Taxnx cbohctb onepainiH " + " , KaK accoiniaTHBtiocTb h KOMMy- 

TaTHBHOCTb , n03B0JIHeT yMeHbHIHTb BpeMH KOMMyHHKaHHOHHblX B3aHMOJ0,eHCTBHH 3a CHeT B03MOJKHOCTH HX 

onTHMH3an;iiH[38, 39, 40"ll41|. CymecTBeHHbiM HBjraeTCH tot cpaKT, ^ito onTHMH3anHH MescnponeccopHbix B3a- 
hmo^ghctbhh Mo:sceT 6biTb npoH3Be,a,eHa Ha ypoBHe KOMMyHHKaniiOHHOH 6n6jiH0TeKH hjih H3biKa nporpaM- 
MiipoBaHHH, ^ito o6ecneHHBaeT BbicoKyio MC^KnjiaTcpopMeHHyio nepeHOCHMOCTb nporpaMMHoro o6ecneHeHiis, 
BKjnonaioiHero b ce6a AjiropHTM ^hxotomhh. 



3.3 BbiHHCJieHHe first, last — KOMnoHeHT, 

nponecc BbiHHCjieHHa first{XJi}, last{Ui} komhohght coctoht H3 flByx STanoB: noflroTOBHTejibHoro, koto- 
pbift BbinojiHHeTca o^hh pa3 fljia Bcex npaBbix nacTeii (|12|) h npouecca ahxotomiih, na kotopom bbihiicjihiotch 
peineHHH fljia KajKflOH npaBoft nacTH. 



3.3.1 IIoflroTOBHTejiBHMe bbihhcjighhh. 

Ha no^roTOBiiTGjibiiOM 3Tane Ha to-om npoueccope jiOKajibiio 6e3 KOMMyHiiKainiOHUbix B3aiiMOfleiiCTBHH bm- 
hhcjijhotch flBe ctpokh MaTpimbi A^ 1 



A T G L = e ,4 T G R = e 

m L i "to Tor! 



(18) 



3pfiCb h flajiee m l , thr onpe,n,ejieHbi KaK 

first{V m } = (X) mr ,last{V m } = (X) 



(19) 



a efc- opT -BeKTop. 

,Z[onojiHHTejibHO Ha no/i,roTOBHTejibHOM 3Tane BbiHHCjiaiOTCJi flBa BeKTopa 



vR _ (-1 r R r R 



(20) 



G 



KOMnoHGHTbi KOToptix onpeflejiaiOTCH H3 peinenHH chctcm 



{A}? 



Z m R +l 



+ 1 



Z 



\ 



R 

ma+2 
Ii 



V 

/ 

V 



— a mL -i ) 

-C mR +l ^ 









/ 



(21) 



(22) 



3aTpaTBi Ha noflroTOBHTejibHbie BbiHHCjieHHH pjisi AjiropHTMa ,Z[hxotomhh cocTaBHT size{Z^ L } = 0(n). 
TaKiiM o6pa30M, AjiropiiTM Ahxotomhe hmcgt cmbicji npHMeroiTb jijih penieHHH HecKOjibioix CJIAY c opr 
hoh h Toii >Ke MaTpHneii (|12[) h pa3jiHHHMMH npaBbiMH nacTHMH, T.e. b cjrynae, Korjia noflroTOBHTejibHbiMH 
Bbi^iiicjiGHiiHMH mojkho npeneGpeHb. Otmgthm, hto o6i>eM BcnoMoraTejibHbix BbiHHCjieHHii AjiropHTMa Jia- 
xotomih 6ojibine no cpaBHeHHii c ajiropiiTMOM [35, 36[ 137) . TeM He MeHee 3th 3aTpaTM OKynsTCH 3a c^bt 
coKpam;eHHa BpeMenn KOMMyHHKarniH. 



3.3.2 OcHOBHaa cpopMyjia. 

Ha btopom 3Tane AjiropHTMa ,H,hxotomhh pjin bbihhcjichhji firts, last - sjieMeHTOB HcnojiB3yeTCH npeacTaB jieHne [17] 

( m— 1 p 



E ft ( Z f) k + E # ( Z "), ' ( X ) fc - first{U m }, 

3=1 



j=m 



(X) fc = 



E#( z *)* + E ^( z i) fe) w fc = i«t{u m }, 

j — 1 j— m+l 



(23) 



ft 



£ (F).(G^) = £ (F) 3 .(G 



m 7 -j ' 



]=m L 



j=m L 



(24) 



3flecB HHfleKCbi mji,mL onpeflejiHiOTCH jiOKajibiro na KajK^OM nponeccope corjiacHO (|19p . 

TaKHM o6pa30M, npn peajiH3anHH AjiropHTMa ^hxotomhh pacneT first, last - KOMnoHeHT cbojthtch k 
BbiHiicjieHHio cyMM (|23[) . Tor/i,a KaK ajiropHTMbi [351 1361 I37| Tpe6ytOT peuieHHH BcnoMoraTejibHoft CJIAY 
pa3MepnocTH 2p — 2. OneBHiTHO, hto BbinncjieHHe cyMM Ha MHoronponeccopHOH BHrnHCJiHTejibHoft CHCTeMe 
mojket 6biti> peajiH30BaHO c 6ojibHieH scpepeKTHBHOCTbio, neM ajiropHTM HCKjiiOHeHHH Faycca, nosTOMy Aji- 

rOpHTM JJlIXOTOMHH n03BOJIHeT flOCTHHb 6ojiee BBICOKOH npOH3BO,Ii;HTejH>HOCTH nO CpaBHGHHIO C MeTOflaMH 

[551 131)1 [37] ,h,jih 3a^,an BH/ja ([1] 



3.3.3 MPI peajiH3au;HH npou,ecca ahxotomhh. 

PaccMOTpHM nocjieflOBaTejibHOCTb fleitcTBHii pjia peineHHH Tpex/piaroHajibHOH CJIAY c noMombio AjiropHT- 
Ma ^hxotomhh Ha p — 7 nponeccopax. 

B cooTBeTCTBHH co cnerj;H(pHKaH,neH (|13[) , (| 14|) , Ha nponeccope c HOMepoM m pacnpe,a,ejiHiOTCH nojTBeKTopbi 
(U rra , Q m ). Ha noflroTOBHTejibHOM 3Tane, KOTopbifi BbinojiHHeTCH o^hh pa3 jj,jih Bcex npaBbix nacTeii, Ha m- 
om nponeccope fljia onpejrejieHHs: BeKTopoB Z„,Z„,G^,G;^ peinaiOTCH 3ajj,anH ([T5 |) . (pH]) . ([2"2")l . 

B Hanajie BToporo 3Tana Ha npon;eccope c HOMepoM m bbihhcjihiotch jiOKajibHbie BejiHHHHbi (3^, 0^ b 
cooTBeTCTBHH c (|24p . 

JJ^ajiee, Ha KascflOM ypoBHe s = 1, [log 2 p] nponecca ahxotomhh h3 (phc.[5]) bbihhcjihiotch 2 s ~ 1 sjieMeH- 
tob H3 BGKTopa peiueHHH no (popMyjie (|23p . B jiaHHOM cjiynae Ha nepBOM ypoBHe ^hxotomhh bbihiicjihiotch 
KOMnoHeHTbi (X) fc = first{\J±} h (X) fc = last{\3±\ . 

Ha mare 1 nocpeflCTBOM Bbi30Ba kojijickthbhoh cpyiiKi^HH MPI_Reduce Ha^ KOMMyHHKaTopaMii Commi, Comni2 

BblHIICJiaiOTCa BejIHHHHBI 



Xi 



= E^( Z 



3 / ki 



X2 



7 



3=5 



(25) 



7 



War 1 



War 2 




War 3 CCOOOCCO OOGO CCCO CCCO OCOO OCXX) 



MPI_Send( ) TZZ. MPI_Send( ) 

( X )k1 ( X )k2 

War 4 CCOO OCCO ,pcco CCCO CCOO^OOOO CCCO 

y L \ R 

riepecneT [B^ riepecneT Pg 

MPI_Reduce (....) MPI_Reduce (....) MPI_Reduce (....) MPI_Reduce {....) 

War 5 CCCOCOCO CCCO OOCO cccd CCCO Coco 



War 6 cccoooCQ ccco 



COCO 



ccco qcoq ooco 



War 7 OCOO ooco ooco 



coco 



OCOO OCOO CCCO 



Phc. 2: 3ian pa3/i,ejieHHH CJIAY b cjiynae p = 7. 



Ha inare 2 npoueccop 3 noctijiaeT nponeccopy 4 BejinHiray xii a npoueccop 5 - BejiHHiray %2 

Tenepb Heo6xoflHMbie KOMnoHeHTbi, pacnojiojKenHBie Ha 4 -om nponeccope MoryT 6bitb bbimhc jrenbi , KaK 



(X) fci = /zr,st{U 4 } = xi + X 27? ^ + & , 



(G R ) 

(X) fe = Zas*{U 4 } = Xi + X2 + /3 4 R 



(26) 

G i 



Ha inare 3, ,zyiH Toro uto6bi hckjikdhhtb HaimeHHbie KOMnoneHTti H3 chctcmbi ypaBHemiii (npoii3BecTH 



pa3/i,ejieHHe chctcm), npoueccop c HOMepoM 4 nocbijiaeT npon,eccopy 3 BejiiiHiray 5 L = ( X2 | GH j t2 + /3 4 ) (^^Ofa— i 



, a nponeccopy 5 BejiniHHy S R = ( Xi fp^' 1 + 0± ) (^4')^, +1 cooTBeTCTBeHHO. 



( G ?) fcl 
( G 9 fcl 

Ha inare 4 MO/niepHnnpyeTCH BeKTop npaBoii nacra CJIAY (|15[) . (|16|) . (|17[) : KaK cjie,n,CTBHe ([24]) , na npo- 
neccopax c HOMepaMii 3 n 5 nepeBbi^HCjiaiOTca BejinnnHBi 

Pft = Pf + 8 L , ft = ft + <5 R , 



rjj,e (X) t = last{\J^}, (X) = /irstjUs}, Ha cjieflyiomeM ypoBHe jthxotomhh aHajiornnHBiM o6pa30M 
pa3flejiaiOTCH CHCTeMbi (|15[) , (|17p . ^jih SToro b cootb6tctbhh c (|23p bbihhcjihiotcji pemeHna fljia KOMnoHeHT 
/irsi{U2, Ug}, ^asi{U2, Ug}. nocjie 3aBepinenHH npou,ecca pa3flejiemiH iicxo/nmsi CHCTeMa 6yn,eT pa3,a;ejieHa 
Ha He3aBHCHMbie nojj,cncTeMbi (| 16j) , fljia penieHHH KOToptix mojkct 6bitb npHMeHeH KaKoii-jiH6o H3 BapnaHTOB 
MeTO/ja nporoHKH|14). 

B flajiBHeiiiHeM /tjih onpe,n,ejieHHa penieHHH /tjih flpyroft npaBoii nacTH H3 (|12[) noTpe6yeTCH nepeBBiniic- 
jiHTb tojibko BejiHHHHbi /3 R,L , TOiyja KaK BeKTopbi Z R,L , G R,L nocTOHHHbi pflsi Bcex npaBbix nacTeli, TaK KaK 

3aBHCHT TOJIBKO OT BHfla MaTpHIlBI. 



8 



3.4 BbiHHCJiHTejibHbie h KOMMyHHKaijHOHHbie 3aTpaTM npou,ecca ^hxotomhh. 

B |17) noKa3aHO, hto npn peajiii3ainiH onepainin All-to-One-Reduce Ha ochobc ajiropHTMa |44| onemca Bpe- 
MeHH nponecca ahxotomhh iiivieeT Biifl 



rjj,e a — BpeMa 3aflep>KKH ,n,o Hanajia nepejianH jxaHHbix Mexjxy npoueccopaMH (jiaTeHTHOCTb), ft - BpeMa 
nepe^anH ojxnoro nncjia, 7 - BpeMa BbinojmeHHa onepaniiH cjiojkchhh flByx nnceji, I - hhcjio cepnn ofl- 
HOBpeMeHHO peinaeMbix CJIAY. CpaBHHBaa nojiyneHHyio oueHKy c ou,eHKOft pjin ajiropHTMa HHKjiHHecKOH 
pejxyKiniH |15) 



3aKjiiOHaeM, hto ajiropiiTM ^hxotomhh (popMajibHO Tpe6yeT 6ojibinero BpeMeHH c^eTa, o,zniaKO b cjiynae, 
ecjiH peinaiOTCH HecKOJibKO cepnii sajjan h BejiHHHHa jiaTeHTHOCTii a He3HaHHTejibHa, to ohchkh (|28|) . (|29p 
npaKTHnecKH coBna^aiOT. 

BbicoKaa npoH3BOflHTejii>HOCTb ajiropHTMa /hixotomhh no cpaBHeiiHio c MeTOjrpM ihikjikhcckoh peflyK- 
hhh o6ecneHHBaeTca 3a chst coKpameHiia BpeMeHH KOMMyHHKainiH h BpeMeHH CHHxpoHH3aHHii Bbinncjie- 

HHH. CoKpaHXeHHe BpeMeHH KOMMyHHKaiHIH B03MOJKHO 6jiarO,H,apH TOMy, HTO OCHOBHaH KOMMyHHKaHHOHHaH 

onepainia " + " AjiropHTMa ^hxotomhh o6jia;iaeT cbohctbom acconnaTHBHOCTH. ApxHTeKTypa coBpeMeHHbix 
cynepKOMnbiOTepoB TaKOBa, hto BpeMa napHbix B3aHMOjxeHCTBHH pjin pa3jiHHHbix npoueccopoB mojkct cyine- 
CTBeHHO pa3jiHHaTbca 1301 131| . AcconfiaTHBHOCTb BbiHHCjieHHH pa3peniaeT na ypoBHe KOMMyHHKainiOHHOH 
6n6jiHOTeKH hjih H3biKa nporpaMMiipoBaHiia onpeflejiHTb nopajTOK B3aHMO^,eftcTBiiH 113 TaKHM o6pa30M, 
HTo6bi yHHTbiBaa apxHTeKTypy cynepKOMnbiOTepa, MHHHMH3iipoBaTb BpeMa o6m6hob jraHHbiMH. Oprariroa- 
niia o6m6hob nepe3 Bbi30Bbi He6jiOKiipyioiHeH cpyHKHHH "All-to-One-Reduce(+)"no3BOJiHeT coKpaTHTb BpeMa 
CHHxpoHH3an,HH nponeccopHbix ajieMeHTOB. ^eftcTBHTejibHO, ecjiH b paMKax ojxhoh rpynnbi npoueccopoB 
cymecTByiOT jj,Ba CBo6o,znibix 113 c noflroTOBjieHHbiMii jj,aHHBiMH, to KOjijieKTHBiiaa onepainia "(+)" Ha,n stoh 
rpynnofi nponeccopoB mojket HanHiiaTb BbinojmaTbca, p^me ecjin npeflbiflyiHHH Bbi30B "All-to-one- Reduce" 
Ha Bcex nponeccopax He 3aBepnieH. HanpHMep, npoueccopbi c HOMepaMH 1 h 2 (cm. pnc. [2]) Ha mare 1 MoryT 
cjio>KHTb / nepe^aTb cboh ^aHHbie h HanaTb BbinojiHeHne niara 5 6e3 CHHxpoHH3arniH BbinHCjiennii c jjpyniMii 
nponeccopaMii . 

4 MHCJieHHbie SKcnepHMeHTbi 

,ZIpBO.nbHO nacTO 3(p(peKTHBHbie c TeopeTHnecKOH toikh 3peHHH napajijiejibHbie ajiropHTMbi npn hx peajin- 
3ainiH Ha cynepKOMnbiOTepax MoryT He o6ecneHHBaTb ojKH/i,aeMoro coKpameHiia BpeMeHH cneia. B nepByio 
onepe^b sto CBH3aH0 c TeM, hto npn aHajiH3e sepcpeKTHBHOCTH KOHKpeTHoro ajiropHTMa jxocTaTOHHO cjiojkho 
o6"beKTHBHO ynecTb Bee oco6eHHOCTH BbiHHCjiHTejibHbix chctcm (BpeMa iipcTyna k naMHTii, jiaTeHTHOCTb h 
nponycKHyio cnoco6nocTb ceTH h t.^;.). IIosTOMy HHCJiemibie SKcnepHMeHTbi c MO^ejibHbiMH nocTaHOBKaMH 
3ajj,aH sbjihiotch Ba>KHbiM STanoM HecjieflOBaHHH napajijiejibHbix ajiropHTMOB. 

4.1 PenieHHe ypaBHeHHa Akycthkh. 

B i^HjiHHflpHHecKOH CHCTeMe KOop,n,HHaT (r, z) b nojiynpocTpaHCTBe z > paccMOTpHM npo6jieMy MOjj,ejinpo- 
BaHHH pacnpocTpaHeHHH axycTHHecKHx bojih ot ToneHHoro HCTOHHiiKa 



f Dichotomy = (21og 2 (2*)a + %^Z(2 7 + /?)) = 

= a pog a (p) + 1] Iog 2 (p) + 21 (log 2 (p) - ^) (7 + 



(28) 



'-^Cyclic Reduction 
V 



21og 2 (p) (a + lp + li), 



(29) 




(30) 



Byn,eM nojiaraTb, hto npo6jieMa (|30[) pemaeTCH npn HyjieBbix HanajibHbix flaniibix 



du 



= 0. 



(31) 



4=0 dt 



t=o 



1 KoMMyHHKaTOp - B TepMHHOJIOrHH MPI. 
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By/jeM CHiiTaTb, hto npH z — noBepxHOCTb HBjiaeTCH cbo6o,h,hoh, a no KOopflHHaTe r n z BBefleHM BcnoMO- 
raTejibHbie rpaHiinbi 

du 



dz 



z=0,h 



\r=h 



0. 



(32) 



rpaHiinbi r = ii h z = li Bbi6npaiOTCH trkhm o6pa30M, hto6m .ztjih paccnnTMBaeMoro MOMGHTa BpeMeHH He 

B03HHKajIO BOJIH, OTpa>KeHHMX OT HEX. ,II,OnOJIHHTejIIjHO nOTpe6yeM BbinOJIHeHHS yCJIOBHH |19) 



du 
dr 



= 0. 



r=0 



Byn,eM HCKaTb pemeHiiH 3an,aHH (|30[) - ()33|) b Bii^e pnp,& Oypte no cpyHKHiiHM JIareppa |18] 



Q, 



,(x)= / u(x,t)(ht)-%C(ht)dt, u(x,t) = (ht)% J2 Q m (x)l*(ht) 

Jo m=0 



(33) 



(34) 



rfi/e l^fjit) opTOHopMHpoBanHBie (pyHKniin JIareppa |42) . KOToptie Bbipa»:aiOTCH nepe3 KjiaccnnecKHe 
nojiHHOMBi JIareppa cjie/ryioiHHM o6pa30M 



C(W) = 



hm\ 



-(ht^e-^L^ht). 



(m + a)l 

3p,eci, m - CTeneHb nojiHHOMa JIareppa, a > 2 - n,ejiaa KOHCTaHTa, h - napaMeTp npeo6pa30BannH. IIpHMe- 
hhh npeo6pa30BaHiie f|34[) k (|30|) (|33p . nojiy^iaeM KpaeByio 3aflany pjin onpeflejieHHH m-ro KOsepcpHinieHTa 
pa3jiojKeHiiH 



fc=0 



<9Q r 



dr 



dQ r , 



r=0 dz 



— Qm\ r= i 1 — 0, 

z=0,l 2 

(35) 

me f m = J™ f(t)(ht)-%l? n (ht)dt. 

flaHHBiii MeTOfl mojkho paccMaTpHBaTb xax aHajior cneKTpajn>HO-pa3HOCTHoro MeTO^a Ha ocHOBe Oypte- 
npeo6pa30BaHHH |43| . o/nraKO, 3/i,ecb pojib "nacTOTbi" BbinojiHaeT napaMeTp m, onpeflejiHromnn CTeneHb 
nojiHHOMOB. ,II,pyroe otjihhhc npeo6pa30BaHHH JIareppa ot Oypte coctoht b tom, hto napaMeTp pa3flejie- 
hiih rapMOHHK npncyTCTByeT tojibko b npaBoii nacTii (|35p . TaxnM o6pa30M, hto6m paccnnTaTb flimaMHKy 
BOjnroBoro nojiH Heo6xoflHMO peninTb cepnio ypaBHeunn BHfla ([1]). Taxaa nocTaHOBKa no3BOjis:eT Hcnojii>30- 
BaTb AjiropHTM ^hxotomhh b paMKax npeflo6ycjiaBjiHBaioni,eH npon,e^ypM, paccMOTpeHHon Bbinie. 

4.2 06pam,eHHe npe,n,o6ycjiaBJiHBaiom,ero onepaTopa. 

B paMKax cxeMM (J5|) /tjih peineHHH 3aflaHH (|35|) Bbi6epeM b KanecTBe npe/i,o6ycjiaBjiHBaioni,ero onepaTop 

B = A r + A z - d, (36) 
rpfi A r , A z onpe^ejieHbi b (j5]l . a KOScpcpiiinieHTbi nojiaraiOTCH cjie,zryK)iHHMiH 

ai(i, A;) = r,F, a 2 («, k) = nV, d(i,k) = r.—p' 1 . (37) 

J\nsi penieHHH 3a,n,aHH By = f BOcnojib3yeMCH MeTO^OM pa3flejieHHH nepcMCHHBix[5, 45j. ilocKOjibKy 
0, 6ya,eM HCKaTb penieHne b Bn^e pa^a no co6cTBeHHbiM (pynKii,HHM pa3HOCTHoro onepaTopa A z : 



Dz 



2 = 0, l 2 



Vi,k 



^(^(l) + E^)cos( - (fc - 1 / r f- 1) )), l<i<M-l, 1<*<^, 



(38) 



2 BBefleM o6o3HaHeHHe f = \ (min^gg /(x) + max l6 g /(x)) . 
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r fl e onpe/i,ejiHiOTCH 113 peniemiH TpexflHaroHajibHoft ciiCTeMbi ypaBHemiii 

, a-2 2 ^{l - 1) 



A r + sin^ 7 - rf) = <f>(l), l = l,...,N 2 . (39) 

CyMMH (|38p 6yn,eM BbiHiicjiHTb, iicnojib3yH nocjiejjpBaTejibHbiii ajiropiiTM 6biCTporo /niCKpeTHoro npeo6- 
pa30BaHHa <J>ypt>e [5, 47] , a ^jih onpeflejieHira penieHiiii 113 cepiiii ypaBHeHHii f|39[) - ncnojib30BaTb AjiropiiTM 
fluxoTOMHH fljia peuieHHH cepHH TpexflHaroHajibHbix ciiCTeM ypaBHeHHii. 

OcTaHOBiiMCH Ha HeKOToptix acneKTax peajiii3an,iiii AjiropHTMa ^hxotomhh b paivntax MeTOjj;a pa3,n,ejie- 
hhh nepeMeiiHtix. Ojxho H3 orpaniiHeiiini Ha o6jiacTb npHMeHHMOCTH AjiropHTMa ^hxotomhh coctoht b tom, 
hto Bee CJIAY H3 cepHH flOjBKHbi BKjnonaTb oflHy h Ty »ce cpiiKCiipoBaHHyio MaTpimy (|12[) . 3to no3BOjiaeT 
npene6peraTb 3aTpaTaMH Ha nojjxoTOBiiTejibHbie BbiniicjieiiiiH. OflHaKO jj,jih Q39p ycjiOBHe nocToaHCTBa MaT- 
piinbi tie BbinojiHaeTCH, nosTOMy fljia 3Toro cjryrafl AjiropiiTM ^hxotomiih ne npiiMeHHM. C jxpyroii CTopoiibi, 
Heo6xofliiMOCTb MHoroKpaTHoro oGpainemiH onepaTopa no3BOjiaeT paccMaTpHBaTb coBOKynnocTb ypaBneinni 
(|39|l KaK cepnio sa^an Bii,a,a (|12[) fljia (piiKCiipoBaHHoro / n, cjieflOBaTejibHO, ncnojib30BaTb AjiropnTM fliixo- 

TOMIIH. 

4.3 OlI,eHKa npOH3BO,ZI,IlTejII>HOCTH. 

B KanecTBe TecTOBOii Bbi6epeM MOjj,ejib cpejibi Tuna 'TeojiorHHecKHii c6poc" , rjj;e CKopocTb pacnpocTpaiie- 
hhh bojih b cpejj,e V s (x) 3a/i,aHa b cootb6tctbhh c pnc. [3Ja, npn stom njiOTHOCTb cpejibi 6yjj,eM nojiaraTb 
nocTOHHHOii p(x) = 1. 

PICTURE 



Phc. 3: Moflejib cpejxbi " reojioriiHecKiiii c6poc" 



Hctohhhk BOjiHOBoro nojiH pacnojiojKiiM b Hanajie KOopjo,iiHaT, a BpeMemiyio 3aBiiciiM0CTb CHraajia 3a- 

flSflHM B BHfle 

(27r/ (t-to)) 2 " 



fit) = exp 



T 



sin(27r/ (t -to)), 



(40) 



c napaMeTpaMH /o = 30Hz, to = 0.2s, 7 = 4. AnnpoKCiiMainiH ypaBHemis (|35|) npoBO/nuiacb Ha paBHOMep- 
Holi ceTKe Q c hhcjiom y3jiOB N\ — N2 = 2 k , k = {11, 12, 13, 14, 15}. Hhcjio cjiaraeMbix b pa^e (|34|) 6mjio 
orpaiiHHeno n = 2000, a napaMeTpbi pasjioacemia nojiarajiiicb cjiejxyiomiiMii a = 5, h = 300. 

,ZI,jih on,eHKii npoH3BOji,iiTejibHOCTii npe^,jiaraeMoro ajiropiiTMa 6bijin peajiii30BaHbi HeHBHbift Tpexcjiofnibifi 
x Ie6binieBCKiiH 11 CG-MeTOjj,bi, a jj,jih o6pameniifl npeji,o6ycjiaBjiiiBaiomero onepaTopa - MeTOjj; pa3jj,ejienH5i 
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nepeMenHbix. HauajibHoe npn6jiHJKeHHe b cxeMe ([5]) fljia Bcex Q„, n = 1, ...,2000 3a,a,aBajiocb HyneBbiM bo 
Bceii pac^eTHOH o6jiacTH, a HTepaniionHbiii npon,ecc 3aBepinajics no flocrioKeHiiio ycnoBHH 

n AQ k n -f\\ __ 10 



/ 



< 10" 



Tflfi fc-HOMep HTepan,iiH. C yueTOM Bbi6paHHOii fleKOMnosHiniH pacneTHon o6jiacTH pnc. 21 peineHiie Tpex/nia- 
roHajibHbix CHCTeM ypaBHeHHft (|30[) BbinojiHHjiocb b nanpaBjieHHH r, a Oypbe-npeo6pa30BaHiie psp npoBO- 
jxnjiocb b nanpaBjieHHH z. 

Bee HHCjieHHbie npouejxypbi 6bijni peajiH30BaHbi Ha H3biKe Fortran-90 c Hcnojib30BaHiieM MPI-TexHOjionm. 
/Fjih BbinojinenHH 6biCTporo cpypbe-npco6pa30BaHHs: Hcnojib30Bajiacb 6n6.niiOTeKa FFTW[48j. BbrancnennH 
npoBOfliijiHCB Ha cynepKOMntiOTepe "MBC-lOOk" Me^Be/ipMCTBeHHoro CynepKonbiOTepHoro Hempa PAH, 
nocTpoeHHoro Ha ochobc neTbipexajrepHbix nponeccopoB Intel Xeon, pa6oTaioiinrx Ha nacTOTe 3 FFn, h co- 
eflHHeHHbix KOMMyHHKamiOHHOii cpe,ii;ofl: Infiniband. 

Ha pnc. [5j h Ta6ji. 1 npHBejreHbi 3aBHCHMOCTb BpeMeHH cneTa (T) n BejinnnHbi ycKopeHiis (S) ot micna 
nponeccopoB ^jih oflHoft HTepaniiH npn penieHiin 3a,zi;anH (|35|) MeTO^OM He6biineBa n MeTO^OM conpHJKeH- 
Hbix rpajxneHTOB. npn peajiH3anHH sthx ajiropHTMOB Ha cynepKOMnbiOTepe 6bijio floCTHrayTO nonm jiHHeii- 
Hoe ycKopeHHe fljia ceTOK pa3jiHHHon no,a,po6HOCTH b ninpoKOM jxHana30He nncjia nponeccopoB. ^ocTiirHy- 
Tbiii ypoBeHb ycKopenHH o6ecnennBaeTCH 3a cneT npHMeHemisi AjiropHTMa ^hxotomhh, Tax KaK ocHOBHbie 
KOMMyHHKan,noHHbie 3aTpaTbi npiixoflHTCH Ha penieHHe TpexjxnaroHajibHbix CJIAY npn oGpamennH npe- 
,n,o6ycjiaBjiHBaiom,ero onepaTopa. TaKinvi o6pa30M, TpeGoBamiH o6ecneneHHH bmcokoh MaccniTa6HpyeM0CTH 
ajiropiiTMa h bo3mo>khocth npoBeflemiH pacneTOB c Hcnojib30BaHHeM tbichh nponeccopoB moxho cnnTaTb 

BbinOJIHeHHblMH. 

PICTURE PICTURE 



Pnc. 4: ,ZPdKOMno3HHHs: pacneTHon o6jiacTH Pnc. 5: 3aBHCiiMOCTb BpeMeHH cueTa ot nncjia 

nponeccopoB pjisi ceTKH A^i = N2 = 2 k ,rp,e k = 
a) 12; b) 13; c) 14; d) 15. 



size 


2048x2048 


4096x4096 


8192x8192 


16384x16384 


32768x32768 


NP 


T 


S 


T 


S 


T 


S 


T 


S 


T 
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64 


1.4e-02 




8.0e-02 




3.5e-01 




1.7 








128 


7.3e-03 


122 


3.7e-02 


138 


1.8e-01 


124 


7.2e-01 


151 


3.9 




256 


6.3e-03 


142 


1.8e-02 


284 


9.0e-02 


254 


4.3e-01 


253 


2.15 


172 


512 






l.le-02 


465 


5.0e-02 


448 


2.0e-01 


544 


1.01 


463 


1024 






1.0e-02 


512 


2.7e-02 


829 


1.0e-01 


1088 


5.4e-01 


924 


2048 










2.0e-02 


1120 


7.0e-02 


1554 


3.2e-01 


1560 



Ta6jiHna 1: 3aBHCHMOCTb BpeMeHH cneTa o/nroii HTepannn (F) n KOScbcpHnneHTa ycKopemra (S) ot nncjia 
nponeccopoB jijia CG-MeTO,a,a. 

Bbinie o6painajiocb BHHMaHiie na to, hto H3-3a najiHHHa KOjijieKTHBHbix B3aHMO,n;eHCTBHa THna "AU- 
to- All-Reduce" , peajiH3ainia MeTO^a conpa>KeHHbix rpa^neHTOB Ha cynepKOMnbiOTepe mojkct 6biTb MeHee 
3cpcbeKTHBHa, neM Hcnojib30BaHiie He6biineBCKoro na6opa napaMeTpoB. O/iTiaKO BbiHiicjiHTejibHbie SKcnepn- 
MeHTbi He bhhbhjih cymecTBeHHbix pasjiHuiiH b 3aBHCHMOCTH BejiHHHHbi ycKopeHiia ot HHCjia nponeccopoB 

PJISl 3THX MeTOflOB(pHC. [S]) . ,3,eHCTBHTejIbHO, COnOCTaBJIHH OHeHKH BpeMeHH KOMMyHHKaH,HOHHbIX B3aiIMO- 
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fleficTBHii pjm CG-MeTO^a h AjiropiiTMa ,Hhxotomhh 

rpCG, all-reduce = 2 \ og ^ p ) a + £_± + 2 f3) , 

rpDichotomy = a + y + j _ £^ (<y + 2/?) ^ 

3aKjiiOHaeM, hto pjm BbiHHCjiHTejibHbix ciictcm c hh3koh b&jihhhhoh jiaTeHTHOCTH a npn ycjiOBHH I ^> 1, 
BpeMH MejKnponeccopHbix B3aHMO,n,eHCTBHH CG-MeTO,na Ha cpOHe KOMMyHHKaiiHOHHHX BsaHMOfleficTBHii Aji- 

TOpilTMa ,HhXOTOMHH He3HaHHTejIbHO. 

PICTURE 



Phc. 6: Moflejib cpe#w Marmousi. 

C jrejibio oneHKH tohhocth nojiynaeMoro peineHHH, pjisi MO,a,e.nH "FeojiorHHecKHH C6poc" Ha pnc. [3] a 
npiiBefleHO BOjiHOBoe nojie momght BpeMeHH t = 2.5. Ha puc. [3]b. pjin ceTOK pa3jiHHHOH no,irpo6HOCTH npn- 
BefleHa 3aBHCHMOCTb aMnjiirryznj bojihoboto nojiH Bflojib npHMOii Slice(z) = u(\.2km, z). Bh,h,ho, hto toh- 
hoctb nojiynaeMoro peineHHH 3HaHHTejibHO 3aBHCHT ot HHCJia y3JiOB ceTKH, npHxoflHmeecH Ha xapaKTepnyro 
fljnray BOJiHbi. IIpHHHMas, peHienne, nojiynenHoe c Hcnojib30BaHHeM caMoii no,zrpo6HOH cctkh h r = h z = 
1/280A, A ~ 33m b KanecTBe TOHHoro, nojiynaeM cjie/ryronnie oh,chkh ckopocth cxo/himocth HHCjieHHOft 
cxeMbi: 





N x 


| U — U j| 


ll«-«i/all 


M A 


INI 


||«-«l/4ll 


1/35A 


4096 x 4096 


0.45 




90840 


1/70A 


8192 x 8192 


0.11 


4.09 


90590 


1/140A 


16384 x 16384 


0.022 


5 


90680 



Ta6jiHH,a 2: 3aBHCiiMOCTb tohhocth peineHHH h KOjinnecTBa o6pameHHH npc [ n;o6yc.jiaBjiHBa:EOiHero onepaTopa 

OT HHCJia y3JIOB CGTKH. 

Bh/i,ho, hto npn yMeHbineHHH npocTpancTBeHHoro niara b ,n,Ba pa3a BejiHHHHa norpeniHOCTH b ceTOHHOii 
HopMe L2 yMeHbniaeTCH b 4 h 5 pa3 cooTBeTCTBeHHO. TaKHM o6pa30M, npefljiaraeMbiii ajiropHTM o6ecneHiiBa- 
eT BTopoft nopHflOK tohhocth no npocTpaHCTBy. ^onojiHHTejibHO otm6thm, hto hhcjio o6pam,eHHH npeflo6y- 
cjiaBjiHBaK)m,ero onepaTopa Ma npH peineHHH 3a,n,auH (|30[) npaKTip-iecKii He 3aBiiCHT ot HHCjia y3JiOB ceTKii. 
TaKHM o6pa30M, npe^jiaraeMaa: npe,ii;o6ycjiaBjiHBaioiii,aH npoue/rypa 3(pcp eKTHBHa B cjrynae, KOiyja TpeGyeTCH 
npoBOflHTb pacneTbi c bmcokhm npocTpaHCTBenHbiii pa3penieHHeM npH yMepenHoii KOHTpacTHOCTii cpeflbi. 

flonojiHHTejibHO pjir peajibHbix npocTpaHCTBeHHO-BpeMeHHbix MacniTa6oB 6bijio npoH3Be,n,eHO MOflejinpo- 
Bamie pacnpocTpaHemiH aKycTiinecKHx bojih ,zijih MO^ejin cpenbi "Marmousi" (phc.|BJi,6) [49] . Ha piic.[7]npH- 
Be/i,eHa 3aBHCHMOCTb aMnjiHTyflbi nojiH ot BpeMeHH pjin flByx npneMHHKOB c KOop/niHaTaMH xi = (30Ai , 0) , X2 — 
(70Ai, 0), hctohhhk BHfla (|40|) TaK :sce 6biji noMemeH b Hanajie KOop/niHaT. PacneTbi npoBO/nuiHCb Ha ceTKax 
c hhcjiom ysjiOB N r x N z = {4096 x 1321, 8192 x 2642, 16384 x 5284, 32768 x 10568}, hto cooTBeTCTBOBajio 
npocTpaHCTBenHbiM niaraM h r = h z = {l/25Ai, l/50Ai, l/100Ai, l/200Ai}, Ai ~ 50m. Hhcjio o6pain,eHHH 
npeflo6ycjiaBjniBaiomero onepaTopa fljia onpeflejieHHH Bcex rapMOHHK Q ni n = 1,...,2000 6bijio nopa/pca 
90000 h npaKTHuecKH He 3aBHcejio ot niara ceTKH. 

TaK corjiacHO pnc. [TJa h pnc. [7]b pa3peinaiOHi,aH choco6hocti> ceTKH 1/25 Ai, l/50Ai He o6ecne x niBa- 
eT npneMjieMoft tohhocth hh fljia nepBoro, hh ^jih BToporo HCTOHHHKa. npn pa3peiHaiOHi,eH choco6hocth 
ceTKH b 1/100 Ai tohhoctb pacneTOB pjin npneMHHKa xi CTaHOBHTCH floCTaTOHHO bmcokoh, oflHaKO, fljia npn- 

CMHHKa X2, KOTOpblH (DHKCIipyeT BOJIHy B 6ojiee n03,H;HHH MOMeHT BpeMeHH, TO^IHOCTb paCHeTOB HeCKOJIBKO 
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PICTURE PICTURE 



a) IlpiieMHiiK xi = (30Ai,0) 6) IlpHeMHiiK X2 = (70Ai,0) 

Phc. 7: CeftcMorpaMMM pjin cpe^bi Marmousi. 

MeHbine. 3tot sepcpe-KT oGycjiOBjieH Tax Ha3biBaeMoii "<pa30BOH oihh6koh" xapaKTepHoii fljia hhcjichho- 
aHajiHTircecKHx mctoiiob|43). TaKHM o6pa30M, npn MOflejiiipoBaiiiiH bojihobmx npoueccoB .zyia fljiHTejibiibix 
BpeMeHHbix nepnoflOB Heo6xo,zpiMO Hcnojib30BaTb cctkh c bbicokoh pa3peiHaioiHeH cnoco6HOCTKEO, hto6bi 
norpeniHOCTb pacneTOB fljia saKjnOTHTCHbHbix momchtob BpeMeHii ocTaBajiact flonycTHMOii. 

5 3aKJiK)HeHHe. 

B pa6oTe npefljiojKeH napajijicjibHbiH ajiropnTM ^jih penieHHa sjijinnTircecKiix ypaBnenHfi BToporo nopa/pca 
c Hepa3,a;ejia:eMbiMH nepeMeHHbiMH. Pa3HOCTHbie ypaBHeHHa, nojiyneHHbie b pe3yjn>TaTe KOHeHHO-o6 r beMHOft 
annpoKCHMan,iiH, peinaiOTca hchbhbim nojiyHTepaHHOHHbiM mctcvuom He6biineBa hjih CG-MeTOflOM. Bbi6op 
onepaTopa JIanjiaca b KanecTBe npeflo6ycjiaBjiiiBaiomero no3BOjiaeT o6ecneHHTb BbicoKyio CKopocTb cxoflH- 
mocth HTepaipiOHHoro nponecca pjisl cpe/i, c yMepeHHoft KOHTpacTHOCTbio, npn stom hhcjio HTepaniiH fljia 
fl0CTH»ceHHa 3a,n;aHHOH tohhocth npaKTH^ecKH He 3aBHCHT ot Hiicjia y3JiOB cctkh. 

IIohth jiHHeiiHaH 3aBHCHMOCTb KOScpcpHHHCHTa ycKopemia h BbicoKaa MacHiTa6HpyeMOCTb napajijiejib- 
Horo ajiropHTMa oSecne^HBaiOTCH 3a cneT Hcnojib30BaHHH AjiropHTMa /Jhxotomhh b paMKax MeTO^a pa3- 
flejieHHH nepeMeHHbix pjisi o6pameHHa npe,zi;o6ycjiaBjniBaioiHero onepaTopa. TaKHM o6pa30M, BbicoKaa npo- 
H3BO/i,HTejibHOCTH AjiropHTMa /],hxotomhh ii npocTOTa ero peajiH3aii,HH no3BOjiaeT sepcpeKTiiBHO pacnapaji- 
jiejiHBaTb SKOHOMHHHbie HiicjieHHbie npou,eflypbi, Tpe6yioiHHe MHoroKpaTHoro penieHHa TpexflHaroHajibHbix 
chctcm ypaBHenHii. 

B paMKax BbiHHCjiHTejibHbix 3KcncpHMCHTOB ycTaHOBjreHO, hto npn MOflejiHpoBanHii pacnpocTpaneHHa 
3ByKOBbix bojih b HeoflHopoflHOii cpe^e fljia peajiBHO npocTpaHCTBeHHO-BpeMCHHBix MacniTa6oB Heo6xOflHMO 
Hcnojib30BaTb cctkh c BbicoKoft paspeniaioiHeH cnoco6HOCTbio. TaKHM o6pa30M, npefljiojKeHHbiH ajiropHTM 
HBjiaeTca BOCTpe6oBaHHbiM, TaK KaK no3BOjiaeT c bbicokoii sepcpeKTiiBHOCTbio h b ncuiHOH Mepe Hcnojib30BaTb 
BbiHiicjiHTejibHbie moihhocth coBpeMCHHbix cynepKOMnbiOTepoB npn penieHiiH 6ojibHinx 3a,n;aH. 

6 Bjiaro^apHOCTH. 

Abtop 6jiaro,n,apHT OaTbHHOBa AT. h MajibiHiKima B.3. 3a MHoroHHCjieHHbie o6cyjK r neHHH pe3yjiKraTOB 
flaHHOii pa6oTbi. 
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